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Summary 


ticularly adept. 


On-line man-computer communication 
requ_res much development before men and 
computers can work together effectively 
in fomulative thinking and intuitive 
proclem solving. This paper examines 
some of the directions in which advances 
can ce made and describes on-going 
programs that seek to improve man- 
machir.e interaction in teaching and 
learning, in planning and design, and 
in visualizing the internal processes 
of computers. The paper concludes with 
a brief discussion of basic problems 
involved in improving man-computer com- 
munication. 

Introduction 

Cn-line communication between men 
and computers has been greatly impeded, 
during the whole of the short active 
history of digital computing, by the 
economic factor. Large-scale computers 

have been so expensive that in 

business, industrial, and university 
applications -- there has been great 
pressure to take full advantage of 
their speed. Since men think slowly, 
that pressure has tended to preclude 
extensive on-line interaction between 
men and large-scale computers. Inex- 
pensive computers, on the other hand, 
have been severely limited in lnput- 
outpui facilities. Consequently, the 
main cr.annel of on-line man-computer 
Interaction, in the world of commerce 
and in the universities, has been the 
electric typewriter. 

In critical military systems such 
as SAGS, the economic factor has been 
less restrictive and the need for man- 
computer Interaction greater or more 
evident. However, the SAGE System, 
the pioneer among computerized military 
systems, is "computer-centered 11 -- less 
so in operation than in initial design, 

but still clearly computer-centered 

and that fact has had a strong influence 
upon man-computer interaction in mili- 
tary contexts. The computers and their 
programs have tended to’ dominate and 
control the patterns of activity. The 
scope for human initiative has not been 
great. Men have been assigned tasks 
that proved difficult to automate more 
often than tasks at which they are par- 


?or the kind of on-line man- 
computer interaction required in computer- 
centered military systems, a console' 
featuring a Characcron display tube, a 
light gun," and arrays of display 
lights and push buttons proved effective. 
At one time, about four years ago, at 
least 13 different companies were manu- 
facturing such consoles -- different in 
minor respects but all alike in basic 
concept. Until recently, therefore, on- 
line r.an- computer ccrrmunication could 
be summed up in the chrase: electric 
typewriters and SAGE consoles. 


Increasing Need for Mar- Computer 
symaiosis ~ 


During the last year or two, three 
trends that bear upon on-line man- 
computer interaction have become clear 
First, the cost of computation is de- 
creasing; it is no longer wholly un- 
economic for a man to think in real 
time with a medium-scale computer. 
Second, time-sharing schemes are begin- 
ning to appear in hardware form; the 
economic obstacle fades as the cost of 
a computer is divided among several or 
many users. Third, more and more people 
are sensing the importance of the kinds 
of thinking and problem solving that a 
truly symbiotic man-computer partnership 
might accomplish: 


1. Military officers are eager to 
regain the initiative and flexibility 
of command they feel they lost to the 
computers in computer-centered command 
and control systems, but they want to 
retain the storage and processing 
services of the computers. 


2. A few mathematicians are 
finding computers very helpful in ex- 
ploratory mathematical thinking. 

Working closely with powerful computers 
and graphic displays, ‘ they are able to 
see at once the consequences of experi- 
mental variations in basic assumptions 
and in the formulation of complex ex- 
pressions. 


3. Several persons responsible 
for the programming of computerized 
systems are beginning to believe that 
the only way to develop major programs 
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rapidly enough to meed hardware time 
scales is to substitute, for the large 
crews of programmers, coders, and 
clerks, small teams of men with sophisti- 
cated computer assistance small teams 

programming "at the console." With 
statement -by- statement compiling and 
testing and with computer-aided book- 
keeping and program integration, a few- 
very talented men may be able to handle 
in weeks programming tasks that ordi- 
narily' require many'teople and many 
months. 


b. To formulate auestions and 
hypotheses -- human; 

c. To select approaches -- human; 

d. To detect relevance -- human; 

e. To recognize patterns and 
objects — huma 1 ; 

f . To handle unforseen and low- 
probability exigencies -- human; 


4. In war gaming and even to some 
extent ir. management gaming, there is a 
growing feeling that the value of exer- 
cises will increase greatly if the pace 
can be speeded. On-line interaction 
between the gamers ar.i computers is 
required to speed the pace. 


5. In the planning and design of 
systems of many kinds, digital simulatio: 
is recognized as a valuable technique, 
even though the preparation and exe- 
cution of a simulation program may take 
weeks or months. There Is now a growing 
interest in bringing the technique under 
direct ar.d immediate ctntrol of planners 
and designers -- in achieving the 
availability and responsiveness of a 
desk calculator without losing the 
power , ar.i scope of the computer. 


6. In the field of education, 
some of the far-reaching possibilities 
inherent in a meld of ’’programmed in- 
struction" and digital computers have 
become evident to many. 


T. The complex equipment used ir. 
exploratory research, now in scientific 
laboratories and perhaps shortly in 
space, requires overall guidance by 
scientists but, at the same time, de- 
tailed control by computers. Several 
groups are currently interested in 
"semi-aurcmatic laboratories. " 


g. To store large quantities of 
information -- human and computer; with 
high precision — computer; 

h. To retrieve information rapid- 
ly -- human and computer; with high 
precision — computer; 

i. To calculate rapidly and accu- 
rately — computer; 

j. To build up progressively a 
repertoire of procedures without suffer- 
ing loss due to interference or lack of 
use — computer. 

It seems to us that the functions 
listed, a through j, are the essential 
ingredients of creative, intellectual 
work. In most such work, they are nop 
strung together in simple temporal 
sequence, but intimately interrelated, 
often operating simultaneously with much 
reciprocal interaction. For that reason, 
the conventional computer-center mode 
of operation, patterned after that of 
the neighborhood dry cleaner ("in by 
ten, out by five"), is inadequate for 
creative man-computer thinking; a tight, 
on-line coupling between human brains 
and electronic computers is required. 

We must amalgamate the predominately 
human capabilities and the predominately 
computer capabilities to create an 
integrated system for goal-oriented, 
on- line-inventive information processing. 


The foregoing considerations 
suggest that man-compuper communication 
will be an active field during the nexp 
few years and that efforts to facilitare 
productive interaction between men and 
computers will receive wide appreciation 

Man-Computer Complementation 

The fundamental aim in designing a 
man-oomputer symbiosis is to exploit 
the complementation that exists between 
human capabilities and present computer 
capabilities : 

a. To select goals and criteria 

human; 


In associating capabilities a 
through f primarily with human beings 
and capabilities g through j primarily 
with computers, we are of course des- 
cribing the present state of affairs, 
the technology in which we now must 
work, and not asserting any essential 
discontinuity between the domains of 
human and machine information proces- 
sing. There is always the possibility 
that human competence in g through j 
can be significantly increased, and it 
is almost certain that machine 
competence in a through f will develoo 
rapidly during the next decades. At 
present, however, we think that man and 
computer complement each other, and that 
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the intellectual power of an effective 
man-oomputer symbiosis will far exceed 
that of either component alone. 

Steps Toward Man-Computer Symbiosis 

To bring men and computers together 
in tight synergic interaction, we must 
make advances in several contributory 
fields. Among the most Important appear 
to oe: time sharing and other possible 
solutions to the economic problem; 
memory and processor organization for 
contingent retrieval of information and 
programming of procedures; programming 
and control languages; and on-line 
input-out equipment, including Integrated 
displays and controls. The groups with 
which we are associated have been working 
w h ?!V^ a3 ‘ Xt is disappointing to 
afc the areas appear to grow more 
rapidly than we can explore them and to 
realize how trivial are our accomplish- 
ments relative to the requirements. 
However, we are beginning to have some 
tangible results, and it may be worth- 
while to illustrate briefly the follow- 
ing three: 

1. A system for computer-aided 
teaching and computer- facilitated study. 

2. A man-oomputer system for use 
in the planning and design phases of 
architectural and constructional problems. 

3. Two programs that display as- 
pects of the internal processes of a 
computer during execution of programs. 

Computer-Aided Teaching and Learning 

Exploration of ways in which a 
computer can facilitate teaching and 
learning raises several problems in man- 
oomputer communication. Effective 
teacher-student relations involve nearly 
continuous interchange of information, 
and anything that interferes with the 
oonynunloation is likely to Impair 
effectiveness. 

The importance of rapid, convenient 
student- teacher communication has 
demonstrated itself quite clearly in 
experiments with a simple, automated, 
language- vocabulary-teaching system. 

One version of the system. Tutor 1, uses 
a computer typewriter as the communi- 
catlon link between the student and the 
machine. Let us examine first the 
procedure briefly and then the problem 
01 typewriter communication between 
student and computer. 

twn T v! e 1 ty P escr ’iP t of the sample German- 
Engllsh lesson, shown in Fig. 1, 


illustrates the procedure. In a ses^-inn 
with Tutor 1 , the student initiates 0 ° 
b ?« typin = Th® computer 

wants or not the st cdent 

wants detailed instructions. The 

student replies by typing "a" for "Ho 
start the lesson." The computer selects 
Germcin word at random and presents it. 
J?® s 5 ud ®" p , then an English word 

that he thinks is equivalent in meaning 
j™ terminates his resoonse by hitting 

is e a ce e nL e b? d i 0t I. If «« response 

i,% a ° ? pt bl ® '-de computer, the com- 
put-r types + for correct." (Brevity 
p® ) If it wants another 

En = lish equivalent, the computer then 
types the German word again. If it does 
not want another English equivalent, it 
types the item score and the cumulative 
and tifers a comment on 
the student's performance. When the 
student misses a word, the computer 
types - for incorrect" and "ta" for 
Do you want to trv again 9 " If the 
student replies "y" for "yes," the com- 
puter presents the missed German word 
ag the stua -"t replies "n" for 

no, the computer types an English 
equivalent and requires the student to 
copy it. And so forth, as illustrated. 

The first thing we found out about 
W3S phat students (children and 
adults) who type well like to use it. 
whereas students whc do not type well 
may be attracted at first but soon tire 
of the lesson. During the development 
°£, P r°™ sever£l variations were 
tried out. Those that speeded the pace 
of presentation or streamlined the 
procedure of response were the most 
successful. A version that eliminated 
the requirement that the student tyoe 
the response — that allowed him to 
"l sp ° nd really or subvocally and then 
trusted him to score his answer -- was 
greatly preferred by students who typed 
??i ly w fa i rly wel1 or ? oor ly; good typists 
uM«! d t yP e - the -answer" versions better. 
With one type-the-answer program, de- 
signed to avoid all possible inter- 
ruptions, students who type well sat for 
two or three hours a* a time, industri- 
ously adding new German, French, or 
L3.tin words to their vocabularies 
occasionally checking their cumulative 
scores, but never asking for coffee 
breaks. 

Twenty years from now, some form 
of keyboard operation will doubtless be 
taught in kindergarten, and forty years 
from now keyboards may be as universal 
as pencils, but at present good typists 
are few. Some other symbolic input 
channel than the typewriter is greatly 
needed. J 
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We make some use of the light per. 
and "light buttons" associated with 
multiple-choice questions and answers 
displayed on the oscilloscope. When the 
alternative courses of action can be 
laid out in a tree- like branching 
structure, it is convenient to let the 
computer ask a multiple-choice questicr. 
via the.voscilloscope display and to 
arrange the program in such a way that 
touching the light pen to the button 
associated ■■■:1th particular response 
brings forth, a subordinate question 
appropriate to that response. With 
four familiar alternatives, the operator 
can make a selection every second or 
two (i.e., select at a rate of 1 or 2 
bits per second), which is adequate fcr 
some purposes, though not truly 
competitive with talking or expert 
typing (up 20 and 40, respectively, 
bits per "second in situations in which, 
the pace is not limited by judgmental 
processes) . 

In computer-aided teaching, the 
restriction tc a small ensemble of 
multiple-choice responses sometimes 
precludes truly convenient, natural 
communication, and it leads into 
controversy with those who think that 
the "constructed response" methods are 
inherently superior. In our work thus 
far, it appears that the difference ir. 
effectiveness between constructed- 
response ar.d multiple-choice procedures 
is small compared with the difference 
between a convenient, fast response 
mode and ar. inconvenient, slow one. 
Convenience and speed influence markedly 
the student's enjoyment of his inter- 
action with, the computer and the lessen. 
The most important sub-goal, we believe, 
is to maximize the amount of enjoyment, 
satisfaction, and reinforcement the 
student derives from the interaction. 

And good student-teacher communication 
appears tc be absolutely essential to 
that maximization. 

Good man-computer communication is 
important, also, in systems in which 
the computer serves to facilitate 
learning without taking the initiative 
characteristic of most human teachers. 

Vie are working on a system. Graph 
Eauation, the aim of which is to 
facilitate a student's exploration of 
the relations between the symbolic and 
graphical forms of mathematical 
equations . 

The program displays, for example, 
the graph of a parabola (see Fig. 2), 
and below the graph it displays the 
equation. 


y = afx-b)* -vo. (1) 

Associated with each of zhe parameters, 
a, b, and c, is a potentiometer that 
controls trie value of the parameter. 

The studenz can vary the parameter 
values at will and zee, directly and 
immediately, the correspondence between 
the configuration of those values and 
the shape of the parabola. Vie are in 
the process of substituting, for the 
potentiometers, "light scales" with 
pointers operated by the light pen and 
of displaying numerical coefficients 
instead of letter parameters on the 
oscilloscope. Even in zhe present crude 
form, however, the system is an 
effective aid. It presents the linkage 
between the symbolic ar.d the graphical 
representation in a dynamic way. It 
lets the student explore many more 
configurations than he could explore if 
he had to plot graphs or. paper. And 
it lets him see "answers" while he is 
still thinking about "questions" —• 
something we think may be very Important 
in learning. 

We plan, of course, to have the 
Graph Equation system operate 
dynamically in the other direction, 
also. The student will draw a rough 
parabola. The computer will fit an 
accurate parabola to the rough one and 
display the accurate one. At the same 
time, the computer will calculate and 
display the coefficients. The 
completed system, we hope, will provide 
the student with a flexible, responsive 
study tool. It will not have much 
practical value as long as it is re- 
stricted to parabolas, of course, but 
it should be possible, with a faster 
machine, to handle Fourier transformg, 
convolution integrals, and the like. 

Often the student must manipulate 
characters of text with reference to 
pictorial or graphical information. We 
have been able to handle some of these 
functions but still lack an integrated 
system for communication of interrelated 
symbolic and pictorial information be- 
tween the student and the computer. 


The work on computer-aided teaching 
and learning is supported by the United 
States Air Force under Contract No. 

AF33 (6l6)-3l52 and is monitored by the 
Training Psychology Branch, Behavioral 
Sciences Division, Aerospace Medical 
Research Laboratory, Aeronautical 
Systems Division, Air Force Systems 
Command. 


Computer-Aided Planning and Design 

In starting to explore the field of 
computer-aided planning and design of 
systems, we have focused on hospitals. 
Hospitals pose very interesting and 
difficult — and we believe to a large 
extent typical — system problems be- 
cause the relative importance of the 
various planning factors varies from one 
local context to another, because so 
many kinds of interest and -experience 
are relevant and eager to make them- 
selves felt, and because tangibles and 
intangibles are so intimately inter- 
related. One of the main alms in setting 
up a computer system to facilitate 
hospital planning is therefore to 
provide a means through which general 
guide lines and local constraints can 
Interact. Another is to permit several 
persons with various backgrounds and 
interests to look at tentative plans 
from their own differing points of view 
and to manipulate and transform the plans 
during the course of their discussion. 

A third (since the intangible factors 
must ultimately be converted into 
tangible, physical form) is to give the 
planners a way of sketching out their 
suggestions and then relating them, 
quickly and conveniently, to all the 
other considerations that have been 
introduced. 

Coplanner, a computer-oriented plan- 
ning system with which we have been 
working, is essentially: 

1. The PDP-1 computer with type- 
writer, oscilloscope, light gun, and 
magnetic-tape unit. 

2. An ensemble of empirical data 
describing the commerce (communication 
of information, transportation of ob- 
jects, and movement of personnel) that 
goes on in typical hospitals. 

3. An ensemble of programs for 
accepting, storing, retrieving, proces- 
sing and displaying information. 

In our work thus far with Coplanner, 
we have experimented with hypothetical 
hospital situations, using two or three 
members of our own group and an outside 
expert or two as the planning team. In 
preparation for a team planning session, 
we load Into core the programs most 
likely to be wanted first and make ready 
the tapes containing the rest of the 
programs, the ensemble of empirical data, 
and the material generated in previous 
planning sessions. 


The members of the planning team 
then sit before the oscilloscope. They 
start to discuss, for example, a hosoital 
that is expanding its plant and must 
relocate and enlarge its X-Ray Depart- 
ment. They come to the question: Where 
should the X-Ray Department be located, 
relative to the other departments and 
facilities, in order to minimize the 
cost of its interdepartmental commerce? 

One of the members of the team re- 
trieves, through the computer, a record 
of previous analyses that provides data 
on the major components of X-Ray commerce: 

a. transport of patients, 

b. trips by doctors and internes 

to supervise x-ray examinations, to study 
x-ray films, and to consult with 
personnel of the X-Ray Department, 

o. communication not involving 
movement of personnel, and 

d. routine personnel activities 
such as entering or leaving duty stations 
and taking meals and breaks. 

In response to typewriter commands, 
the computer then prepares and displays 
several graphs to summarize the quanti- 
tative commerce data. The graphs are 
mainly distribution graphs and histo- 
grams. Since they refer to hospitals of 
the same type and size, but not to 
precisely the one being planned, intui- 
tive judgment suggests modifications to 
take into account various features of 
the local context. Members of the team 
make the adjustments in the process of 
discussion. All they have to do to in- 
crease the height of a bar in a histo- 
gram is to touch the top of the bar with 
the light pen and lift It to the desired 
level. Usually there will be discussion 
of the change and several successive 
adjustments of the graph. If the graph 
is a frequency histogram, raising one 
bar automatically lowers the others. 
Efforts have been made to create a 
favorable context for exercise of the 
planners' intuitive judgment. Provision 
is made for labeling, filing, and later 
processing alternative quantitative 
summaries if the planners do not agree 
fully on a single summary. 

Figure 3 shows two graphs of the 
type developed in this phase of the 
planning discussion. 

The planners of course have several 
different ideas concerning the new layout 
of the hospital. To make these ideas 
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concrete, they display prepared floor 
olans -- a separate plan for each floor 
of each version --or sketch them 
directly or. the screen of the oscillo- 
scope, using the light per. as a stylus. 
Sketching is facilitated 'ey the computer, 
which posts a background outline plan 
having the proper dimensions and showing 
Existing structures that cannot readily 
be altered'.' in its "straight-line" mode, 
the computer plots straight lines even 
if the sketcher's lines are wavy. In its 
11 preference ally-parallel -co-axes" mode, 
she computer plots lines precisely 
parallel to the x axis if the sketcher 
makes them approximately sc, etc. On 
their sketches, which they can readily 
file away and recall for revision, the 
planners label the various departments 
and the stairs, elevators, dumbwaiters, 
etc. Each label, typed or. the typewriter, 
appears at the top of the oscilloscope 
screen, ar.d then is adjusted to desired 
size, trapped by the light pen, moved to 
its proper location on the plan, and 
dropped there. Each label serves as a 
storage and retrieval tag for the sketcr. 
to which it is attached. The plan can 
therefore be made up in small parts and 
displayed as a whole. V.'ithin a few 
months, the program will be capable of 
filing ar.d retrieving assemblies by name. 

Having ter.oatively worked out their 
ideas about X-E.ay commerce and sketched 
several physical arrangements, the 
planners now turn to the proolem of 
evaluation. Eirst, they select one of 
the commerce- distribution hypotheses and 
one of the physical layouts for exami- 
nation and designate them as input data 
to a fast-time simulation program that 
converts the commerce pattern from a set 
of statistical distributions to a 
seauence of individual trips and calls. 
■Then they apply a program that finds the 
best routes fer the trips and calls and 
computes expected durations and costs. 

In calculating cost, the amounts of time 
spent by various categories of personnel 
are weighted appropriately. The weighting 
function can, cf course, be discussed 
and varied by the planning team. The 
calculated ccsc provides an evaluative 
measure for the selected layout under 
the selected commerce hypothesis. 
Actually, several different evaluative 
formulas are ordinarily used. The cor- 
responding cost figures are saved for 
later use. 

The evaluative procedure is then 
applied to other combinations of layout 
and commerce hypothesis. When all the 
combinations have been treated, the 
planners recall the cost figures and 
compare them. Cr. the basis of this 


comparison, they usually discard all but 
the best two or three schemes. They 
modify the best ones, introduce new con- 
siderations developed as a result of the 
study, and make further simulation and 
evaluation runs. 

Figure 5 shows an output-display 
prepared by the evaluation program. 


If the planners are inclined to go 
into detail in certain areas. Coplanner 
is prepared to assist them. An elevator- 
simulation routine, for example, provides 
= dynamic display of elevator operation 
under the loads specified by a selected 
commerce-distribution hypothesis and a 
determination of best routes. Direct 
dynamic simulation has important roles 
to play in work of this kind because it 
aopeals to non-mathematical planners 
more directly than does queuing-theory 
analysis performed with the aid only of 
symbolic assumptions and equations. 
Sometimes dynamic simulation is a sub- 
stitute for" the abstract theory; some- 
times it is an introduction to the 
abstract theory; sometimes it is a check 
upon the abstract theory. 

In the preceding discussion, one 
small facet cf the hospital planning 
problem via.- used to illustrate the ap- 
proach we a.-e advocating. We have 
developed a fairly powerful system to 
facilitate planning in the area dis- 
cussed and ir. related areas. In other 
areas, the system is only starting to 
develop. The computer parts of the 
system are r.ct intended, we should 
emphasize, tc calculate optimal plans or 
designs; they are Intended to provide 
memory, manipulative, computing, and 
display functions in such a way that 
they can be integrated with the more 
intuitive functions supplied by the 
human parts of the system.* 

Visualizing the Operation of 
lomputer Programs 

The covertness of the operation of 
the programs of electronic computers 
makes it difficult for us to develop of 
them the same direct, perceptual kind 
of comprehension that most of us have 
of familiar mechanisms, the moving parts 
of which we can see and touch. The 
great speed with which the programs run 
* “ " ' 
Coplanner was developed under USPHS 

Project W-59, Collaborative Research in 
Hospital Planning. J.J. Souter, A. I. A., 
and M.B. Ercwn, M.D., past and present 
Project Directors, and J.I. Elkind and 
W.E. Fletcher participated in the 
formulation of the system. 


( 

■ 


adds to the difficulty, of course, but 
we are in the habit of solving the speed 
problem — for example, through "slow 
motion." Unless a window or a plastic 
model will provide solution, however, we 
are in the habit of letting the problem 
of covertness go unsolved. We tend to 
be satisfied with extremely indirect 
procedures for interrogation and for 
drawing inferences. In the case of the 
human brain, for example, a neuro- 
physiologist may try' to construct a 
model of an internal process on the basis 
of waveforms recorded from 10 or 100 of 
the million or billion neurons Involved, 
plus microscopic inspection of several 
slices of the tissue prepared in such a 
way as to render visible one or another 
feature of its architecture. Our ap- 
proach to computers is comparable: When 
trouble arises and the results do not 
turn out as we expect them to, we may 
try to figure out what is going on by 
examining with the aid of a typewriter 
control program the contents of supposed- 
ly critical registers, one register at 
a time,. even though we cannot hope to 
look at more than a hundred of the 
thousands or tens of thousands of 
registers involved. Alternatively, we 
may ask for a printout of the contents 
of many registers at some particular 
point in the running of the program, 
hoping to reconstruct the dynamic pattern 
of events from the static view provided 
by the printout. 

Considering the problem posed by 
covertness leads one to think about the 
procedure, introspection , used as the 
basic experimental tool in such early 
psychological laboratories as Wundt's 
and Titohener's, and still widely em- 
ployed in the development, if not in the 
formal testing, of psychological 
hypotheses. Human introspection is a 
useful procedure despite its severe 
shortcomings. How much more useful it 
would be if those shortcomings were 
overcome — if all the processes of the 
brain were accessible to the reporting 
mechanism; if the reporting mechanism 
could describe all the aspects of those 
processes; if the reports were detailed 
and accurate; if introspecting did not 
interfere with the process under 
examination. 

That thought. leads immediately to 
the idea of a computer analogy to, or 
improvement upon, human introspection. 
Clearly, computer introspection can be 
freed of all the shortcomings mentioned, 
except the last, and the last one can be 
turned to advantage. Displaying its own 
internal processes will of course inter- 


fere with the computer's execution of it3 
substantive programs, but only by 
appropriating memory space and time. 

Often, there is memory space to spare, 
and programs normally run too fast for 
the operator to follow them perceptually. 
The conclusion, therefore, is that it 
might be interesting to experiment with 
programs that display various aspects of 
the internal operation of the running 
computer. 

Two such programs, written for the 
PDP-1 computer, are Program Graph and 
Memory Course. Program Graph was written 
with the hope that it would facilitate 
the introduction to computer programming 
and provide displays through which 
certain individual or "personality" 
characteristics of programming style may 
be seen. Memory Course was intended 
mainly for use in "debugging" computer 
programs. Both programs make use of a 
trace routine that executes the in- 
structions of the object program in 
normal, running sequence and, after each 
execution, (a) records in core registers 
the contents of the accumulator, input- 
output register, and program counter, 

(b) does some incidental bookkeeping, 
and (o) turns control over to the dis- 
play routines. The display routines 
develop graphs of types to be illustrated. 

The graphs displayed by Program 
Graph are illustrated in Fig. “57 In 
Fig. 6 a, as each Instruction of the 
object program is executed, its location 
is plotted as ordinate, and the cumulative 
number of executions is plotted as 
abscissa. (Roughly speaking, therefore, 
the graph represents active memory 
location versus time.) Both the ordinate 
and the abscissa scales run from 0 to 
1777 (octal). The interpretation of the 
graph is quite direct: straight-line 
parts of the graph represent straight- 
line parts of the program; jumps repre- 
sent Jumps or subroutine calls; ser- 
rations represent loops. The subroutine 
structure is revealed clearly. If the 
operator knows the general course the 
program should follow, he can detect and 
locate gross faults readily. 

Figures 6B-6D show, for the same 
object program, the contents of the 
accumulator as a function of time. The 
abscissa scale again runs from 0 to 1777. 
In Fig. 6B, the ordinate, scale covers 
the range from -2 1 ? to. 2*- 1; in Fig. 6C, 
it runs from -2^3 to 2 1 !- and in Fig. 

6D, it runs from -2' to 2‘ . Evidently, 
the accumulator is heavily engaged in 
computations involving small numbers. 
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Figures 6E-6G show, for the Input- 
output register, what Figs. 6B-6D showed 
for the accumulator. 


Figure 6H displays the Instruction 
codes. Each instruction code is a two- 
digit octal number. The ordinate scale 
extends from 02 (and) to 76 (operate, 
which is ar. augmented instruction, the 
augmentation not shown) . The most 
heavily used instructions are 20 (load 
accumulator with contents of ) and 54 — 
(deposit contents or accumulator into) . 


Figure ol displays the memory refer- 
ences and the augmentations. Both are 
shown here: either class may be 
suppressed. 


In Fig. 6j, all the graphs of Figs. 
6 A-6I are displayed simultaneously. Be- 
cause the points are shape-coded, it is 
possible, though difficult, to recon- 
struct in detail the sequential pattern 
of a program, from graphs of this type. 
They might therefore find aoplicatlon 
in historical documentation’ of very 
critical computations, such as those 
concerned with rocket launching and air 
defense. Ir. any event, the composite 
representation conveys an impression of 
the great capability computer's have to 
introspect upon their internal processes 
and report about them in detail. 


As we leave this topic, we should 
perhaps mention the phenomenon that 
appears when Program Graph is equipped 
for recursive operation ar.d set to 
display its own operation. The result, 
of course, is only a recursion of 
beginnings, terminated by overflowing 
of the pushdown list. This effect is 
not entirely foreign to human intro- 
spection. 


The routine. Memory Course, plots 
a grid-like map of memory ana displays, 
against the background of the grid, the 
course through memory taken by the ob- 
ject program. The dots of the grid 
represent memory registers, and the dot 
that represents the register containing 
the instruccion presently being executed 
is encircled. As control passes from 
one instruction to another of the object 
program, a line is drawn connecting the 
corresponding registers. The effect is 
hard to illustrate in a still photograph 
because its effectiveness depends largely 
upon the kinetic character of the display. 
However, Fig. 7 may convey an approxi- 
mate impression. Because the photograph 
integrates over time, it shows a longer 
segment of the program's course through 
memory than one sees when he views the 
oscilloscope directly. 


Program . Graph and Memory Course 
are but two or many possible schemes for 
displaying the internal processes of the 
computer. We are working on others that 
combine graphical preservation with 
symbolic presentation. Symbolic presen- 
tation is widely used, cf course, in 
"debugging routines. If many symbols 
are displayed, however, it is not 
possible to proceed through the program 
rapidly enough to find errors in 
reasonable time. By combining graphical 
with symbolic presentation, and putting 
the mode cf combination under the 
operator's control via light oen, we 
hope to achieve both goci speed and good 
discrimination of detailed information. 


Problems to be Solved in 



Among the problems toward which man- 
computer sym ihlosis is aimed — problems 
that men ar.d computers should attack in 
partnership — are some pf great intel- 
lectual depth and intrinsic difficulty. 
The main problems that must be solved to 
bring man-computer symbiosis into being, 
however, appear not to be of that kind. 
They are not easy, but their difficulty 
seems due more to limitations of tech- 
nology than to limitations of intel- 
ligence. 

What we would like to achieve, at 
least as a sub-goal, is a mechanism that 
will couple man to computer as closely 
as man is now coupled to man in good 
multidisciplinary scientific or engineer- 
ing teams. 

For a psychologist to telephone a 
mathematician and ask him, "How can I 
integrate / (dx/(l-x 2 ) )?" required, in 
one empirical test, 105 seconds, in- 
cluding 65 seconds devoted to dialing 
and formalities with the mathematician's 
secretary plus 32 seconds of preamble 
with the mathematician. Io ask the 
mathematician that particular question 
is, of course, wantonly to waste his 
time — 170 seconds of it, in this case, 
since all he needed to say was: "Look it 
up in any table of integrals," and all 
he did say was that sentence embedded in 
a context of encouragement and courtesy. 
(To find a table of integrals 2 and then 
to locate the entry took the psychologist, 
who missed the relevant formula on his 
first pass and started over at the begin- 
ning after scanning 569 entries, 7 
minutes and 25 seconds.) 

* Preliminary study of these displays 
of internal computer processes was 
supported through a contract with the 
Council on Library Resources. 
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What we would like the computer to 
do for us, in the context of the foregoing 
example, does not require such a deep 
solution as an algorithm for formal 
differentiation; it requires merely good 
communication and retrieval. We would 
like to have an arrangement that would 
let the psychologist; write on his desk 
input-output surface: 


and then let the computer replace the 
"what?" -- in perhaps 2 or even 20 
seconds -- by the expression: 


1 -, 1+x 

* l0 S TTIxT 


In the example, our aspiration 
would not stop, of course, with the 
display of expression (3) in symbolic 
form. The psychologist would surely 
want elucidation. His next request 
might be "Please plot a graph," or, if 
the novelty were worn off, simply 
"Graph." We would then like to have the 
computer display on the input-output 
surface a figure, such as Fig. 140 in 
Dwight's Tables.- 5 The figure would, of 
course, be plotted from computed points, 
not retrieved from storage. It would 
be no trouble for the computer to calcu- 
late and present it in a few seconds. 

(For the psychologist to plot a rough 
graph of the integral took 12 minutes. 

For another person to locate a 
published figure (Dwight's) took 17 
minutes: a little more than 16 to get to 
the document room and thumb through 
books that did not contain the figure, 
and then a little less than 1 to pick 
up Dwight's book and scan as far as 
page 29, where the figure is. ) 

Five Immediate Problems 

Consideration of many such examples 
as the foregoing and of what would have 
to be done to put the computer's clerical 
power conveniently and responsively under 
the control of human initiative suggests 
that the main essential steps to man- 
computer symbiosis are the following: 

1. For the economic reason 
mentioned in the Introduction, develop 
systems for sharing the time of digital 
computers among many users on a split- 
millisecond basis. With J. McCarthy and 
S. Boilen, one of us is working on a 


small-scale prototype of such a system 
with five user stations.* 

2. Devise an electronic input- 
output surface on which both the operator 
and the computer can display, and through 
which they can communicate, correlated 
symbolic and pictorial information. The 
surface should have selective persistence 
plus selective erasablllty ; the computer 
should not have to spend a large part of 
its time maintaining the displays. The 
entire device should be inexpensive 
enough for incorporation into a remote 
console. An interesting approach to 

the man-to-machine part of^this problem 
is being taken by Teagher. We are 
employing an oscilloscope and light pen 
to fulfill the function, but they do not 
meet the cost and selective-persistence 
requirements. 

3. Develop a programming system 
that will facilitate real-time contingent 
selection and shaping of information- 
processing procedures. The system must 
permit trial-and-error operation based 
upon "tentative computation": it will 
often be necessary to go back to the 
beginning or to an Intermediate point 
and to try a different attack. We are 
experimenting with interpretive systems 
for on-line assembly of procedures from 
sub-procedures,** and we are planning 
work on console compiling, inter-meshed 
with testing and contingent application 
of procedures as they are required by 
the human components of the man-computer 
partnership. 

4. Develop systems for storage and 
retrieval of the vast quantities of 
Information required to support, simul- 
taneously at several user stations, 
creative thinking in various areas of 
Investigation. For economic reasons, 
such systems must almost certainly be 
hierarchical, moving information from 
large-capacity, fast-aooess storage as 
(or shortly before) the information is 
needed. To achieve the desired effective- 
ness, it will probably be necessary to 
make advances in the direction of 
parallel-access, associative memory with 
preliminary activation based upon apper- 
ceptive relevance. In this area, we 
believe, much fundamental study of 

The work on time-sharing is supported 
by Grant R68568 from the National 
Institute of Health. 

One of the systems Is based on a type- 
writer control program. Process Control, 
written by D. Park. 
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' "formation indexing and of memory of early man-computer symbicses, rather 

oro-anIzatloV. v;lll be necessary before than conversely. 
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ieep and intrinsically difficult. The 
-’ir s t of these areas is computer 
appreciation of natural written languages, 
in their semantic and pragmatic as wel.. 

; s in their syntactic aspects. The 
second is computer recognition of words 
sDOken in context by various and un- 
selected talkers. The third is the , 

-heorv of algorithms, particularly their 
discovery and simplification. The fourth 
is heuristic programming. Vie believe 
that these four areas will in the long 
term be extremely importer.. .0 man- 
computer symbiosis, but that man-compu. er 
oartnershlps of considerable effective- 
ness and value can be achieved without 
t-hem We susoect that solutions in 
“hese areas will be found with the aid 
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Good afternoon. This will be 
your German-English Lesson No. 4. 
If you are ready to start at 
once, please type "s." If you 
would like to review the 
procedure, please type "p." 


re i chen 
re i chen 
64 

8 f fnen 
to open 
-120 

arbeiten 
arbeiten 
to work 
-184 
kochen 
kochsn 

0 

8 f fnen 
64 

rauchen 
64 

arbeiten 
64 

kochen 
64 

mac'nen 
64 
80 

That's it. You did well. I'll 
be looking forward to the next 
lesson. 

pig. 1 — Typescript of a short 
illustrative lesson in which a computer 
Plays the role of instructor in language- 
vocabulary drill. The student typed 0 
to start the session, "s" to start the 
lesson, the English words (and terminat- 
ing dots) in right-hand column, and the 
abbreviations of "yes" and "no" in re- 
sponse to the computer's "ta" ( Do you 
want to try again?"). The computer 
typed the remainder, including scores and 
comments. The procedure is explained in 
the text. 


to hand- + 
to pass- + 

64 good 

to offer- - ta n 
to open» 

-56 poor 

to arbitrate- - ta y 
to look- - ta n 
to work- 

-240 Dumbkopf'. 
to cook- - ta y 
to boil- + 

-240 okay 
to open- + 

-176 hot dog 
to smoke- + 

-112 admirable 
to work- + 

-48 good 
to boil- +• 

16 very good 
to make- +- 

80 Keep it up. 
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Pig. 2 -- Parabolas displayed by com- 
puter to facilitate student's exploration 
of relations between graphical and 
syrbolic representations of mathematical 
expressions. 
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outline plannlr.r sVcetch of one floor in 
a hypothetical hospital. 


I H T E R D E P A R T M E N T h L C 0 M M E R C E 
FOR A PROJECTED COMMERCE 
PATTERN AND HOSPITAL PLAN 


JOOOi- 



TASK 


Fig. 5 -- Oscilloscope display of the 
performance, in respect of "commerce," 
of a proposed hospital plan. Scale time 
is defined as man-minutes spent in 
transit. The contributions of 
individuals to this quantity are weighted 
by coefficients associated with their 
personnel categories. 
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Fig* 6 — Photographs of oscilloscopic 
displays made by Program Srap'n . See 
text for interpretation. 





